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BACKGROUND 

Technical Field 

[0002] The present invention relates to the World Wide Web (hereafter referred to as web) and, 
in particular to the field of web-based advertisement. More particularly, the present invention 
relates to identifying when web users access content on the web to determine the frequency of 
access to particular web content, such as advertisements, as well as the reach and effective reach 
of user access of related content. 

Related Art 

[0003] The web is typically accessed using the HTTP protocol. Web content is formatted in 
HTML or XML. A page is a collection of objects (HTML formatted inline text with embedded 
objects such as applets and images). HTTP protocol allows the user agent, usually a browser to 
issue a fetch of the object using its URL. For example it may issue a request to fetch the URL 
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http ://www. foo .com/index .html . Here www.foo.com denotes the site where the content is stored, 
and index.html is the HTML formatted file to be fetched. The browser then interprets the fetched 
file. During the interpretation additional fetch operations are done for the embedded objects. 
Once a page and all its embedded objects are fetched, a page is completely loaded and is visible 
fully to the end user. 

[0004] In a typical fetch of the page, it might have made a number of fetches (usually referred as 
the GET operation in HTTP) from the same site or from a set of sites where the content is 
distributed. In general, the HTTP operation involves a Request operation that results in a 
Response. A request is characterized by a URL, a request method, a set of HTTP headers, and 
some optional data. A response is characterized by a response code, a set of response headers and 
optional data. 

[0005] HTTP protocol is a stateless protocol. Between two fetches, nothing is remembered. 
However, a cookie specification allows the server to attach a special header called a cookie. 
Cookies are sent back to the server in the subsequent requests providing a way to maintain state 
across HTTP requests. 

[0006] Many web sites include advertisement objects along with their web page content. The 
advertisements can be stored locally or distributed over the Internet. The major metrics used for 
measuring advertising exposure is hits, clicks, page views/impressions, unique visitors, repeat 
unique visitors and total visits. In these metrics, unique users and repeat unique users are the 
most widely used. The distribution of these measurements over different demographic data, 
different time frames and other target segments are needed for evaluating the performance of the 
advertisement and understanding the web user trends and hence enable better targeting. 
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SUMMARY 

[0007J In accordance with the present invention, a system and method are providing for 
measuring the effectiveness of online advertising using reach, frequency and effective reach. 
The system is able to count a user access, even if it is served from a cache. The system is further 
able to distinguish between a unique user accessing a web site for the first time, and users 
making repeated accesses. The system further does not require a calculation using data 
commonly stored in a large data access file log of a server to count users, and preserves user 
privacy while maintaining a count. 

[0008] To minimize the load on a server, counting is performed using a counter cookie. A 
cookie is a (name, value) pair with a set of properties- such as path, domain name and expiration 
time. As one example, the counter cookie stores an object 'o' along with an indication of its 
count of accesses "k", or count(o, k). An object can have more than one counter cookie 
depending on the type of the event log required for the object. For example, if an event has to be 
accounted on yearly and monthly basis then two counter cookies are used. 
[0009] Counter cookies are written to the access log after a count, along with other normally 
stored access log parameters. The counter cookies can be written using either client size script or 
server side script. If there are 'n' entries in the log file, count(o, k) requires only 'n' number of 
comparisons to determine frequency and assure a repeat user is not counted twice, while 
previous systems required nlog(n) computations. 

[0010] A web beacon is used to assure a count occurs even if an object is retrieved from cache. 
The web beacon is a 1 by 1 pixel transparent image inside a page served. The web beacon 
allows a user count even if an object is fetched from cache, the web beacon being specified as 
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not cacheable so that it is retrieved from the origin server every time a request is made and 
represents the original page. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0011] Further details of the present invention are explained with the help of the attached 
drawings in which: 

[0012] Fig. 1 shows a simplified network diagram for components making up the preferred 
system in accordance with the present invention; 

[0013] Figs. 2A-2D are data flow diagrams showing communication between the components 
of Fig. 1; 

[0014] Fig. 3 shows a flow diagram for the components of Fig. 1 for counting unique visitors 
using client side script for calculating the cookie and a web beacon for overriding the caching; 
[0015] Fig. 4 shows a flow diagram for counting unique visitors using server side script for 
calculating the cookies and a web beacon for overriding the caching; 

[0016] Fig. 5 shows a flow diagram for counting unique visitors using client side script for 
non-cacheable pages; 

[0017] Fig. 6 shows a flow diagram for counting unique visitors using server side script for 
non-cacheable pages; and 

[0018] Figs. 7-9 provide data charts showing frequency vs. effective reach taken using a model 
for the preferred system. 

DETAILED DESCRIPTION 

1. Terminology 
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[0019] In accordance with the present invention a method is described for measuring the 
effectiveness of online advertising using reach, frequency and effective reach. The number of 
unique users that access an advertisement at least once over a period of time is called the reach of 
the advertisement over that period of time. The average number of times a unique user accesses 
an advertisement over a period of time is the frequency of the exposure of the advertisement over 
that period of time. The effective reach is the percentage of users reached at a particular 
frequency or higher. These measurements are further extended to different target segments. 
[0020] The reach of an advertisement is calculated by logging the user accesses and counting 
the unique users from the access log using the unique identity assigned to the user. Some 
systems use IP address of the HTTP request source in the access log to count the unique users. 
[0021] The access log (W3C format) contains the accessed URL, source IP address, time of 
access, request headers including cookies. Analyzing the log for unique users involves sorting 
the records in the order of the cookies or DP address and eliminating the duplicates. 

2. Problems Addressed 

[0022] The problems occurring when calculating reach and frequency of web objects include the 
following: 

a. Content Served From Caches 

[0023] The system must be able to count a user access even if it is served from a cache. There 
are browser cache, proxy server cache and Content Delivery Networks (CDNs). 

b. Counting Unique Visitors 
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[0024] The system must be capable of distinguishing between a unique user accessing the web 
site for the first time and the repeated accesses. 

c. Limited Server Load 

[0025] The system should not increase the load on the web server significantly. 

d. Data Extraction From Access Log File Of Servers. 

[0026] The access log file of a web server is normally very big. The system should provide a less 
expensive and speedy solution for counting. 

e. Privacy Preservation 

[0027] The privacy of the user needs to be preserved. 

3. Previous Systems 

[0028] Previous systems for measuring the web page exposure typically include two parts: (a) 
identifying the unique user; and (b) analyzing the web server's access log. Details of these two 
parts are described in the paragraphs to follow. 

a. User Identification 

i. Tracking Visitors Using A Unique ID And Password 
[0029] With this type user identification implemented, every user uses a unique ID and password 
before entering a web site. This method is useful for contents served from a single web site. But 
advertisements are normally spread over many sites and it is not practical to implement user ED 
and password access for all the sites. This method fails to account the content served from the 
caches. Also, it is not able to separate out the repeated access by the same visitor that has already 
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provided an ID. This method further provides a disadvantage since users can be tracked by this 
unique ID, which will breach the privacy of the user. 

ii. Tracking Visitors Using The IP Address For The Visitor 

[0030] Many users use dynamic IP addressing of the Internet Service Provider. In some cases the 
request is made from the proxy server. In this case, the IP address of the visitor as seen at the 
server side will be the IP address of this proxy server. This method, however, fails to account for 
requests made to the caches. 

iii. Identifying Visitors Using Cookies 

[0031] Persistent cookies can be used for identifying a visitor. A cookie is a text only string 
stored in the memory of the browser or saved in a text file at browser side and holds a web site's 
state variables. The cookie string contains a domain name of the web site it belongs to, path of 
the URL, and value. Cookies can be set by the web server or by using client side scripts. 

iv. Other Methods Of Visitor Identification 

[0032] Some methods use a combination of the above three methods i, ii and iii to identify 
visitors. 

[0033] Some systems use a web beacon, or a 1 by 1 pixel transparent image inside a page served. 
The web beacon can solve the caching problem, where access to cached advertisements are not 
identified. This web beacon is specified as not cacheable so that it is retrieved from the origin 
server every time a request is made and represents the original page request. 

b. Counting From An Access Log 
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[0034] An access log is typically hosted at either the publisher site or remotely at a third party 
site. Expensive computation is typically used to count the unique users. An even more expensive 
computation is typically used to calculate frequency of access and effective reach. 
[0035] The count of unique users involves a counting process and comparison checks with 
previous entries to assure that a user is not counted twice. During a typical count of users in an 
access log file, repeated accesses get logged in the same log file. To count only unique users, at 
each step of the counting process, comparisons with the previous entries are needed to make sure 
that this user is not counted already. When checking the i th entry, (i - 1) comparisons are to be 
made with the previous entries. The maximum number of comparisons needed at each step 
follows the sequence 0, 1, 2, 3, 4, n-1 where 'n' is the total number of entries in the log file. 
The total number of comparisons is the sum of comparisons at each step and this yields a 
function of 0(nlog(n)) comparisons. 

[0036] Calculating the frequency of access takes more computations than for calculating the 
unique user count. Convention systems typically do not provide an easy solution for calculating 
the frequency and effective reach. 

4. Overview of System According To Present Invention 

[0037] In accordance with the present invention, a preferred system and method are provided 
for determining the reach, frequency and absolute reach of an object. The distribution of the 
data with respect to demographic and different time frames is also provided. 
[0038] The preferred system is explained using an object and event model. The preferred 
system is described to include two sets <N, V> where N is an expanding set of users and V is a 
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set of web page views. A hit is defined as the request made to the server for fetching an object. 
Web page view is defined as a hit for the web page. 

[0039] To define the system, initially let the web page view 'VP include a set of objects {ol, o2, 
o3, o4..., on}, including an advertisement object. Further, let the number of unique users to a 
web page over a period of time 't' be c lJ t '. Let the number of unique users who are visiting the 
web page for i th time over a time period T be £ Ui t \ 

[0040] An event is identified as e = <n, o> where a unique user 'n' access a unique object 'o\ 
Let E = [ei, e 2 , ...] be the list of events happening over a period of time c t\ Let index(ei) be a 
selector function returning the associated object index of the event e*. Eg: if e, = <nl, o4> then 
index(e0=4. Let seq(ej) give the frequency of e, in E. Let eq(x, y) be a function which returns T 
if x and y are equal. eq(x, y) = 1 if x = y. eq(x, y) = 0 if x * y. A function count(o, k) is then 
defined as the count of all the events ej = <ni, o> where ei 8 E and seq(ej)=k. This gives Urt = 
count(o, k). The function count(o, k) is then calculated using: 

n 

count(oj, k) = £ seq(index(ej), i) | ej 8 E and seq(ej)=k. 

j=0 

[0041] The reach of an advertisement is the number of unique users over a period of time. The 
reach of an advertisement over a time period t = count(o,l), where 'o' is the advertisement 
object. The effective reach of an advertisement object V is the count(o, k) where k = 1, 2, 3, . . . 
[0042] The preferred system uses read and write capability of cookies for uniquely identifying 
the frequency of events. The term 'counter cookie' is used to represent this. The counter cookie 
is written to the access log along with other access log parameters. 

[0043] A cookie is a (name, value) pair with a set of properties- path, domain name and expiry 
time. Using the same counter cookie for objects from a domain can save the cookie storage 
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space. One method the preferred system uses is to represent the value of the counter cookie as a 
(name, value) pair of counter cookies of the domain with a delimiter. 

[0044] The same object can have more than one counter cookie depending on the type of the 
event log required for the object. For example, if an event has to be accounted on yearly and 
monthly basis then two counter cookies are used. For getting the results on various target 
segments, the target information also needs to be logged into one or more access logs. This can 
be achieved in two ways, one is to log the information directly into the access logs and the other 
is to use different access logs for different categories. The second method is preferred since it 
needs a lower number of computations for calculating the reach. 

[0045] To establish a cookie count, let C = {ci, c 2 , C3, . . Cn} be the set of counter cookies for a 
system. Let val(c, n) = the current value of a counter cookie V for the user 'n\ When an event 
ej = <n i5 Oj> occurs, the value of the counter cookie is: 



[0046] This event is logged with the value of the counter cookie and the object identifier 
(normally the URL of the object). When an event repeats, the counter cookie value 
corresponding to this event is incremented. Incrementing the counter cookie can be done using 
the client side script or server side program. The counter value for count(o, k) over a period of 
time is obtained by counting the entries in the log file, where the value of the counter cookie 
equals V and the unique identifier equals the unique object identifier of the object c o\ If there 
are 'n' entries in the log file, count(o, k) requires only 'n' number of comparisons. Thus the 
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val(c i5 nO = 1 

val(Ci, nO = val(Cj, nO + 1 



if val(Cj, nO is not defined; and 
if val(ci, nO is defined 



where all q s C and belongs to object Oj. 



preferred system requires only 0(n) computations and is very efficient compared to the 
0(nlog(n)) comparisons of prior methods described previously. 

[0047] The preferred system uses web beacons for objects that are cacheable, enabling objects 
retrieved from cache to be counted as described above. These web beacons can be used for 
billing the advertisements served and targeting the users for future advertisements. In addition, 
web beacons are used for event forecasting by the advertisement allocation systems. 
[0048] A sample frequency vs. effective reach graph is shown in Figs. 7-9, discussed 
subsequently. The data in Figs. 7-9 is pulled from a model that implements the preferred 
system described herein. Looking at the chart it is easy to understand how effective the ad is on 
different days of the week. The chart shows the variation over a weekend and weekday. 

5. Glossary of Symbols 

[0049] Provided below for reference is a glossary of symbols used in the equations described 
above. 



1. 



o - Tuple of variables. 

eg: <a,b> - tuple of variables 'a' and 4 b\ 



2. 



e - belongs to 

eg: a 8 B denotes 'a 5 belongs to C B\ 



3. 



{} - set of elements 

eg: {a, b , c} - 'a', 'b' and 'c' are the members of the set. 



4. 



[] - list of elements 

[a, b , c] - a list of elements 'a', 'b' and 'c\ 



5. 



S - summation 



n 



eg:If(j) =f(0) + f(l)+... + f(n). 



j=o 
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6. | - given that 

This means do the operations on the left side of ' ! ' if the expressions on 
the right hand sides are 'true'. 

7. 0() - order of 

eg: O(n) - to the order of n. 

7. System Components And Operation 

[0050] Fig. 1 shows a simplified network diagram for components making up the preferred 
system in accordance with an embodiment of the present invention. Fig. 1 includes client 
browsers 10, 11 and 12 shown trying to access a web site on web server system 26. Client 
browsers 10 and 11 are connected to the Internet 18 through a proxy server system 14. Client 
browser 12 is connected to the internet 18 using a local area network 16. The web page can be 
obtained from corresponding browser caches 10- A, 11 -A, 12- A or from the proxy cache 14-B 
or from the CDN cache 21 and 22 A. The cookies are saved in the cookie data store 10-C, 11- 
C or 12-C at the browser system. 

[0051] When a client browser 10, 11 or 12 has to access a web page, first it checks in the 
browser cache. A browser keeps a copy of cacheable web pages in its local cache and if the 
content is still valid it uses the local copy. Otherwise, the request is sent to proxy server 
system 14- A. The proxy server system 14- A checks in its proxy cache 14-B and sends the page 
from 14-B if it contains a valid copy. If a valid copy of the page could not be found from 14- 
B, then the request is sent out. The response can be obtained from Content Delivery Network 
(CDN) 21 or 22 if the web publisher uses the service of the CDN. In case any of these caches 
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does not contain a valid copy of the web page, the request is then served from the origin server 
26- A and the event is logged in access log 26-B. 

[0052] Figs. 2A-2D provide data flow diagrams illustrating a request and response flow in 
different cases. In Figs. 2A-2D, the term "cache-hit" indicates an object is in cache and it is 
fresh. The term "cache miss" indicates an object is not in cache, or that the object in the cache 
is stale. 

[0053] Fig. 2 A shows a request served from the browser cache 10A, and a corresponding 
response from the browser cache 10A provided to the browser 10B occurring after a cache hit. 
Although Fig. 2 A references the browser cache 10A of client browser 10, similar events can 
occur in other client browsers such as 11, and 12. Reference to client browser 10 is simply 
made for convenience, as it will be in subsequent figures. 

[0054] In Fig. 2B the browser 10B sends a request to the proxy server 14A upon a cache miss 
from browser cache 10A. The proxy server 14A looks in its cache 14B and it is a cache hit. 
The proxy server 14A then sends the object back to the browser 10B. 

[0055] In Fig. 2C, the browser 10B sends the request to the proxy server 14A upon a cache 
miss from browser cache 10A. It is a cache miss in proxy cache 14B. So the proxy server 14A 
forwards the request to the CDNs. The object is found in the CDN cache 21A. The CDN 21B 
then sends the object to the browser 10B though the proxy server 14 A. Again, CDN system 21 
is referenced for convenience, although other CDN systems such as 22 may experience a cache 
hit. 

[0056] In Fig. 2D, a request is sent to the origin server (assumed to be web server 26A) after a 
cache-miss from the browser cache 10A and proxy cache 14B. In some cases the origin server 
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is referenced after a miss from all of the browser cache 10A, proxy cache 14B and each CDN 
cache. The origin server 26 A then serves the object. 

[0057] Fig. 3 shows a flow diagram for a process using the components of Fig. 1 for counting 
unique user visits and counting repeat visits for a cacheable page. The flow diagram of Fig. 3 
also uses a web beacon and client side script for setting cookies to assure hits from cache are 
counted. The process begins with step 101 where a browser sends a request for a web page 
that has to have user visits accounted for. In step 102, the request is received and served by the 
origin web server or caches. In step 103 the browser receives a response. In step 104 the client 
side script in the web page starts executing to count the response. 

[0058] To provide the count in step 105, the client side script checks whether any counter 
cookie there has been set for this page. If there are no counter cookies set for this page, then in 
step 106 a counter cookie is established and its value set to 1. If the counter cookie for this 
page is established, then in step 107, the counter cookie old value is incremented by T. In 
step 108 the Client side script writes the cookie to the cookie data store. 
[0059] Web beacons are used to assure requests served from caches also get counted. To use 
the web beacon, in step 109, the browser sends the request for a web beacon with the updated 
counter cookie for this domain. In step 110, the web server sends the web beacon and then 
logs the request. The entry contains the URL of the web beacon and the value of the counter 
cookie. If there is more than one counter cookie for this web page, then there will be one entry 
each corresponding to the counter cookies of this page in the access-log. In step 111, the 
browser receives the web beacon. It does not make any difference in the appearances of the 
web page since it is a 1 * 1 pixel. 
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[0060] To complete the process in step 112, the browser checks to see whether there are more 
objects to be retrieved. If there are more objects, in step 113 browser sends a request for an 
object to be retrieved. In step 1 14, caches or the origin web server send the response. In step 
115, the browser receives object and repeats steps 1 10 to 1 15 as long as there are more objects 
in step 1 12. When there are no more objects to retrieve, as determined in step 112, the session 
ends with step 116. 

[0061] Fig. 4 shows a flow diagram for a process using the components of Fig. 1 for counting 
unique user visits and counting repeat visits for a cacheable page, as in Fig. 3. The flow 
diagram of Fig. 4 uses server side script for setting the counter cookies and a web beacon. The 
process begins with step 201 where a browser sends the request for a URL. In step 202, the 
web server or the caches serves the page requested. In step 203, the browser sends request for 
the web beacon specified in the web page retrieved. Before sending the request, the browser 
checks in the cookie store for the counter cookie for this web beacon and sends the cookies 
along with the request for the web beacon. In step 204, the server receives the request. 
[0062] To provide the count in step 205, the server side script starts and in step 206 it checks 
whether any counter cookie is there with the request. If no counter cookie is there with the 
request, in step 207 the server side script sets the counter cookie corresponding to this page to 
T. If a counter cookie is there with the request, then in step 208 the value of the counter 
cookie is incremented by *1\ In step 209, the web server then logs the event in the access log 
file. It uses the URL of the web beacon and the value of the counter cookie. 
[0063] Web beacons are used to assure requests served from caches also get counted. To use 
the web beacon, in step 209, the server gets the web beacon and sends it with the HTTP header 
to set the counter cookie value to the modified value. In step 211, the browser receives the 
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web beacon. In step 212 the browser then gets the set-cookie header based on the web beacon 
and writes the counter cookies to the cookie store. 

[0064] To complete the process in step 213, the browser checks to see whether more objects 
are to be retrieved. If another object is there, in step 214 the browser sends a request for the 
object. In step 215 the server or cache then receives the request and sends the object. In step 
216 the client receives the object, and then steps 213 to 216 are repeated until all the objects 
are retrieved. If no more objects exist, the session ends in step 217. 

[0065] Fig. 5 shows a flow diagram for a process using the components of Fig. 1 for counting 
unique user visits and counting repeat visits. The flow diagram of Fig. 5 uses client side script 
for setting the counter cookies, and the web pages are assumed non-cacheable, so a web beacon 
is not used. The process begins with step 301 where a browser sends the request for a web 
page. If a counter cookie exists for this site, it is sent with the request. In step 302, the origin 
web server sends the response. In step 303, the web server gets the counter cookie that was 
sent by the browser. If no counter cookie was sent by the server, then the counter cookie is set 
equal to T and the event is logged in the access-log. In step 304, the browser receives the 
response. 

[0066] To provide the count in step 205, the client side script starts executing and in step 306 it 
checks for counter cookies set in the system for this web page. If no counter cookies are set, in 
step 307 the client side script sets the counter cookie with an initial value of T. If a counter 
cookie has already been set for this page, then in step 308 the client side script increments the 
counter cookie value by '1\ In step 309, the client side script then writes the cookies to the 
cookie store. 
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[0067] To complete the process in step 310, the browser checks to see whether more objects 
are there to download. If more objects are there, in step 312 the browser sends a request for an 
object, hi step 313 the browser then receives the object. Steps 310 to 313 are repeated until all 
the objects are retrieved. If no more objects exist, the session ends in step 312. 
[0068] Fig. 6 shows a flow diagram for a process using the components of Fig. 1 for counting 
unique user visits and counting repeat visits. The flow diagram of Fig. 5 uses server side script 
for setting the counter cookies, and the web pages are assumed non-cacheable, so a web beacon 
is not used. The process begins with step 401 where a browser sends the request for a web page. 
If a counter cookie exists for this site, it is sent with the request, otherwise the request is sent 
without counter cookies. In step 302, the web server accepts the request from the browser. 
[0069] To provide the count in step 403, the server side script starts running and in step 404 it 
checks for counter cookies set in the request. If no counter cookies are set, in step 405 the server 
side script sets the counter cookie with an initial value of T. If a counter cookie has already 
been set for this page, then in step 406 the server side script increments the counter cookie value 
by T. In step 407, the server sends the requested object with the header to set the counter 
cookie to the new value. In step 408, the server logs the event with the value of the counter 
cookie and URL of the object in the access log. In step 409, the browser receives the object, and 
in step 410 the browser writes the counter cookies to the cookie data store. 
[0070] To complete the process in step 41 1, the browser checks to see whether more objects are 
there to download. If more objects are there, in step 412 the browser sends a request for an 
object, and in step 413 the server receives the request and sends the object. In step 414 the 
browser then receives the object. Steps 41 1 to 414 are repeated until all the objects are retrieved. 
If no more objects exist, the session ends in step 415. 
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[0071] Figs. 7-9 provide data charts showing frequency vs. effective reach taken using a model 
for the preferred system. Fig. 7 shows a plot of the distribution of effective reach vs. frequency 
on a weekday. The total number of unique users is 19205. The reach of the ad with a 
frequency of 2 or more is 15559, i.e. the number of unique users who have accessed the web 
object at least twice is 15559. The total number of impressions served for this ad is 40658. Fig 
8 shows a plot of the distribution of effective reach vs. frequency on a weekend. The total 
number of impressions served for this ad is 47556. The reach is 5852 at frequency 4. Fig. 9 is 
a bar chart showing the weekly distribution of effective reach vs. frequency over a week. The 
total number of impressions served over the week is 108277. 

[0072] Although the present invention has been described above with particularity, this was 
merely to teach one of ordinary skill in the art how to make and use the invention. Many 
additional modifications will fall within the scope of the invention, as that scope is defined by 
the following claims. 
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